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ABSTRACT 

An evaluation was conducted of the fourth year of a 
5-year program in New York City, Choosing Optional Infused Career 
Education for Students in High School Bilingual Programs (Project 
CHOICE)* The project is designed to provide services to 
Spanish-speaking and Haitian-speaking students of limited English 
proficiency at Fort Hamilton and Springfield Gardens High Schools, 
respectively. The project planned to offer eligible students double 
periods of instruction in English as a Second Language (ESL) and 
Native Language Arts (NLA); bilingual instruction in mathematics, 
science, and social studies; career opportunities through on-site 
career workshops and field trips to various companies; a bilingual 
resource enrichment center at both sites; classes in ESL and American 
culture for parents; on-site training sessions for staff; and 
translations of curriculum guides on computer literacy and computer 
scxence. During the 1991-92 school year, the project enrolled 294 
Spanish, 133 Haitian, and 11 unclassified high school students, of 
whom 92.5 percent were eligible for free lunches. The Spanish and 
Haitian NLA programs were strong. Project CHOICE was fully 
implemented* It met its obje-!tives for NLA, career advisement, 
dropout rate, staff development, and parent involvement. The project 
partially met its objective in the content areas. The project came 
close, but failed to meet its objective for ESL. Recommendations for 
program improvement are suggested. Appendixes describe data 
collection and analysis and instructional materials. (RLC) 



k ■ 



ORE A Report 



poosing Optional Infused Career Education for Students in 
High School Bilingual Programs 
(Project CHOICE) 
Transitional Bilingual Education Grant T003A80102 

1991-92 



U.S DEPARTMENT OF EDUCATION 

" "Psearcr^ and Jmprovemeni 

E0UCAr,ON*,^«eSOU«C|S,.P0PMM,0N 



m«'^/^°' ""^^ °' ODin.or.s Stated rh.,dOCu. 
_<J£R) POSH con Of pohcv 



"PERMISSION TO REPRODUCE THIS 
MATERIAL HAS BEEN GRANTED BY 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ERIC)." 



Choosing Optional Infused Career Education for Students 
High School Bilingual Programs 
(Project CHOICE) 
Transitional Bilingual Education Grant T003A80102 

1991-92 



FINAL EVALUATION PROFILE 



NEW YORK CITY BOARD OF EDUCATION 



H. Carl McCall 
President 

Irene H. Impellizzeri 
Vice President 

Carol A. Gresser 
Westina L. Matthews 
Michael J. Petrides 
Luis 0. Reyes 
Ninfa Scgarra 
Members 

Keysha Z, McNeil 
Student Advisory Member 



Joseph A. Fernandez 
Chancellor 



DIVISION OF STRATEGIC PLANNING/RESEARCH & DEVELOPMENT 

Robin Willner 
Executive Director 



It i* ihc policy of ihc New York City Boird of Educiiion noi lo diicrimin*ie on the htvs of rtce, color, creed, rtligion. 
niUonil origlji, jge, handic4pc>lrg condition, nruht'l status, tMUil onert«tion« or in iti educilionjl progrtmf. 
icuviues, tnd employTneni policies, ind to mintain an cnviionmcnt free of Jexuil hixissmcnt. u requutd by Liw. 
Inquinca rejArding compUincc with Appropriate Uwi miy be diroctod to Mercedes A. Nc^field, Diitxtof, Of^cc of 
Eciual OppoctuniLy, 110 UvicgiioaStrcei. Room 601. Broddyo, New Yodc 11201. Tclepbocu: (711) 935-3320. 

7/7/92 




ACKNOWLEDGEMENTS 



Ihis report has been prepared by the Bilingual, MulticuUuraK and Early Childhood Evaluation Unit of the 
Office of Research, Evaluation, and Assessment. Thanks are due to Deuise Canialupo for collecting the data and 
writing the report. 

Additional copies of this report are available from: 

Dr. Tonii Deutsch Berney 

Office of Research, Evaluation, and Assessment 

New York City Public Schools 

110 Livingston Street, Room 732 

Brooklyn, NY 11201 

(718) 935-3790 FAX (718) 935>5490 



FORE>VORD 



The body of this report is preceded by an Extract which presents an overview of salient points of 
the project: funding cycle; enrollment figures; onckgrouud of students sensed; admission criteria; and 
programming features, strengths, and limitations, including the outcome of all objectives. The extract a'so 
presents the conclusions drawn by the Office of Research, Evaluation, and Assessment (OREA) about the 
program and its recommendations for program improvement. 

Tlie extract is followed by the body of the report, tilled Program Assessment . This includes such 
information as staffing, program implementation, and outcome and implementation objectives. 
Instructional objectives are presented first, followed by noninstructional objectives. The report then 
addresses those aspects of programming mandated by Title VII regulations thai do not have specifically 
staled objectives. This may be information on attendance and dropout rale, grade retention, 
niainstreaming, referrals out of the program to meet special needs of the students, and withdrawals. \ 
case history concludes the report. 

Data for this profile were collected and analyzed using a variety of procedures, which are 
described in A ppendix A following the text. 
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EXTRACT 

PROJECT DIRECTOR: Ms, Janine Anastasiadis 
SITES 

Schooi Borough Grade Levels 

Fori Hanilton High School Brooklyn 9-12 

Springfield Gardens High School Queens .9-12 



FUNDING CYCLE: Year 4 of 5 



Enrollment* 



(faU) 
293 
125 



(spring) 
234 
133 



*The project enrolled 438 students (one less than iu the previous year), 355 of whom participated both semesters, 
Male students numbered 218, female 195; gender was not reported for 25, Students served totaled 418 in the fall 
and 367 in the spring. 

STUDENT BACKGROUND 

Native Language Number of Students 



Spanish 
Haitian 
Unreported 



294 
133 
11 



Coumries of Origin 


Number of 


Haiti 


133 


Dominican Republic 


115 


Mexico 


38 


Puerto Rico 


30 


Ecuador 


29 


El Salvador 


15 


Guatemala 


10 


Peru 


10 


China 


7 


Hong Kong 


6 


Nicaragua 


6 


Venezuela 


5 


Other 


21 


Unreported 


13 



Median Years of Education in Native Country : 8.0; in the United States: 2,0 
Percentage of Students Eligible for Free Lunch Program: 92,5 



ADMISSION CRITERL\ 

The project admitted students who scored at or below the 40th p'^rcentile on the Language Assessment 
Battery (LAB) and were thus categorized as being of limited English proficiency (LEP). At SpringGeld Gardens 
High School, participating students had to be speakers of Haitian as indicated by the school's Home Language 
Survey, 
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PROGRAMMING 



Design Featur'is 

Project CHOICE was designed to provide services to Spanish- and Haitian-speaking students of limited 
Euglish proficiency (LEP) at Fort Hamilton and Springfield Garden High Schools respectively. The project was 
designed to offer eh'gible students double periods of instruction in English as a Second Language (E.S.L.) as well 
as instruction in Native Language Arts (N,L.A.). Project staff would offer bilingual instruction in mathematics, 
science, and social studies. Parallel to their classroom instruction, project students would be introduced to various 
career opporJunities through on-site career workshops and field trips to various companies. The project planned 
to organize a bilingual resource enrichment center at both sites to offer students and their families guidance and 
support services. Classes in E.S.L. and American culture would be offered to parents. 

The project proposed to hire one family assistant at Fort Hamilton High School to address many of the 
personal and family problems of newly arrived students, as well as four student aides (two for each site) in the 
1991-92 academic year. The project planned to offer on-site training sessions for staff and provide them with the 
opportunity to attend college courses. Project CHOICE proposed to translate curriculum guides on computer 
literacy and on computer science. It projected the preparation of a bilingual newsletter through which it would 
disseminate information about the program to other sites with similar populations. 

Capacity building. In the 1993-94 school year, Fort Hamilton High School plans to assume all costs of the 
program and will provide services in accordance wiih the Guidelines for Programs under Part 154 of the 
Chancellor's Regulations for LEP pupils. The new funding source will be basic tax levy. The program will have a 
bilingual coordinator funded by tax levy and an educational assistant funded by Pupils with Compensatory 
Educational Needs (P.C.E.N.), 

Strengths and Limitations 

There were strong Spanish and Haitian N.L.A. programs. Staff served as translators and liaison between 
school personnel and project students and parents. 

Personnel at both sites reported that more guidance and family outreach services were needed. Although 
Umited funding prevented the project from hiring a family assistant, the project plans to hire one in the future. 

CONCLUSIONS AND RECOMMENDATIONS 

Project CHOICE was fully implemented. It met its objectives for N.L.A., career advisement, dropout rate, 
staff development, and parent involvement. The project partially met its objective in the content areas. The 
project came close but failed to meet its objective for E.S.L. 

The conclusions, based on the findings of this evaluation, lead to the following recommendations: 

• Reallocate resources to provide additional family assistance and guidance services. 

• Provide additional native language instruction in the content areas. 

• Explore ways of augmenting E.S.L. instruction. Teachers have a variety of techniques available but 
should evaluate them lo see which appear to be most successful. 
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PROGRAM ASSESSMENT 



STAFFING 



Title VII Staff (Total 6) 
rule 

Project Director 
Resource Specialist 
Resource Specialist 
Educational Assistant 
Educational Assistant 
Parent Trainer 
Student Aide 
Student Aide 



Degree 

A. B.D. 
M.A. 

B. A. 

College credit 

AS, 

M.A. 



Language Competencies Title VII Funding 
Spanish, Haitian, French Part-time 



Spanish 

Haitian, French 
Spanish, Arabic 
Haiiian» French 
Spanish 
Spanish 
Haitian 



Part-time 
Part-time 
Full time 
Full time 
Part-time 
Part-time 
Pan-lime 



Other Staff Working with Project Students (Total 57) 



Title 




Degree 




Teacher 


40 


Ph.D. 


2 


Educational Assistant 


6 


A.B.D. 


1 


Guidance Counselor 


4 


M.F.A. 


1 


Grade Advisor 


3 


MAMS, 


38 


A.P. Foreign Lang. 


2 


B.A. 


9 


A.P, Administration 


1 


H.S. 


5 


A.P. Guidance 


1 


Unreported 


1 



Spanish 


TP 16, CP 6 


Italian 


TP 3, CP 1 


French 


TP 5, CP 7 


Haitian 


TP 4 


Mandarin 


TP 2 


Cantonese 


TP 2 


Arabic 


TP 2 


German 


TP 1 


Greek 


TP 1 



Language Competencies and Teaching 

Certification Communicative ProficicnciesrrP.CP) * 

E.S.L. 15 

Spanish 8 

English 7 

Bil. Math Span. 1 

Social Studies 3 

Bil. Science Span. 1 

Bil. Soc. Stud. Span. 2 

Guid'^nce (Eng.) 2 

Mathematics 1 

Special Education 1 

Foreign Languages 2 

French 2 

E.S.L. T.P.D. 1 

Bil. Math. T.P.D 1 

All teachers were certified in the areas in which they taught. 

IMPLEMENTATION AND OUTCOMES (Objectives prefaced by •) 

English as a Second Language (E.S.L.^ 

The project used a number of instructional techniques, including peer tutoring, computer-assisted instruction 

(Cj\.I.), cooperative learning, small-group and whole-class instruction, audiolingual strategies, developmental 
techniques, and dialogue journais. 



See Appendix B for a list of materials used. 



*Teaching Proficiency (TP): Competent to teach in this language. 
Communicative Proficiency (CP): Conversational capability only. 
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H.S L. CIASSES 



Sites 



Level 



Periods Wcckl^jT 



Students Enrolled 



Fori Hamihon High School 



Beginning 
Intermediate 



15 
10 
10 
10 



101 
101 
37 
7 



Advanced 
Transitional 



Springfield Gardens High School Literacy 

Beginning 
lutcrniediate 



10 
10 
10 
5 

10 



21 
21 
50 
44 
25 



Advanced 
Transitional 



• As a result of participation in the program 75 percent of the s:udents will demonstrate a significant 
increase in English language skills. 

Evaluation Instrument; Language Assessment Baitery (LAB)** 

Pretest: May 1991; posttest: May 1992. 

Fort Hamilton High School 

Number of students for whom pre- and posttest data were reported: 203 

Percent of students with prctest/posltest gains: 69.0 

Mean gain: 7.64 N.CE.s (s.d.«lL0) 

Mean gain is statistically significant (/-9.92, p<.05). 

Springfield Gardens Hj^h school 

Number of students for whom pre- and posttest data were reported: 104 

Percent of students with pretest/post test gains: 80,8 

Mean gain: 11.6 N.CE.s (s.d.=11.22) 

Mean gain is statistically significant (/=10^7, p<.05). 

Project met objective at Springfield Gardens High School. Although the students demonstrated significant 
gains in E.S.L*, the project did not meet the objective at Fort Uamiltoii High School. 



OREA used a gap reduction design to evaluate the effect of supplementary insiruction on project students' 
performance on the LAB, Since all LEP students in New York City are entitled to such instruction, no valid 
comparison group exists among these students, and OREA used instead the group on which the LAB was 
nornicd. Test scores are reported in Normal Curve Equivalents (N.C.E.S), which are normalized standard scores 
with a mean of 50 and a standard deviation of 2L06, It is assumed that the norm group has a zero gain in 
N,C.E.s in the absence of supplementary instruction and that participating students' gains are attributable to 
project services. 
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Native Laniiuagc Arts fN.LA.'^ 

Students lacking literacy skills in native language (estimated): Spanish 40 percent, Haitian 50 percent. 

Project staff used computer- assisted, whole class, and small group and individualized instruction; peer 
tutoring; cooperative learning; developmental strategics; and dialogue journals. 

See Appendix B for a list of materials used. 

N.LA. CIJXSSBS 



High School Level Periods Weekly Students Enrolled 

Fort Hamilton Beginning 5 44 

(Spanish) Intermediate 5 167 

Advanced 5 53 

Springfield Gardens Beginning 10 34 

(Haitian) Intermediate 5 38 



• As a result of participation In the project students will demonstrate a significant increase in N.L.A. 
language skills (Spanish or Haitian) 

Evaluation Indicator: final course grades. 

PASSING GRADES IN NA11VE I.ANGUAGE ARTS 



Enrollment 



Language 

Haitian 
Spanish 

Project met objective for N.LA. 



Fall 

48 
215 



Sprin g 

74 
211 



Percent Pas sing 



Fail 

93.8 
80.0 



Spring 

79,7 
80.1 



Content Area Subjects 

The project used whole class, small group, and C.A.I, as well as cognitive learning techniques, peer tutoring, 
and developmental lessons. At Fort Hamihon High School, the students received content area instruction in 
Spanish and English. At Springfield Gardens High School, the contend area instruction was in Haitian 
supplemented by English. Content area courses were offered five limes per week at both sites. 

See Appendix D for a list of materials used. 



# As a result of participation in the program 75 percent of program students will achieve a passing grade in 
the subject areas of math, science, and social studies. 



Evaluation Indicator: final course grades. 
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PASSING GRADliS IN CONTCNT AREA COURSES 



Fall Spring 

High School Subject Enrollment Percent Passing Enrollment Percent Passing 

Fori Hamilton Maihcmatics 221 48.9 199 49.2 

Science 143 66.4 107 83.2 

Social Studies 210 63.8 211 66.4 

Springfield Gardens Maihcmatics 115 50,4 121 56.2 

Science 113 68.1 110 57.3 

Social Studies 120 77.5 116 74.1 



Project CHOICE met the content area objective for science in the spring semester at Fort Hamilton High 
School and for social studies in both semesters at Springfield Gardens High School. The project director will look 
into the possibiiity of initiating a special dual literacy program to assist those students who have difficulty with the 
content area subjects and lack literacy skills in both iheir native language and English. 

Project partially met objective for content areas. 



Career Advisement 

• As a resuU of the program, all program students will participate in at least two career conferences. 

At Springfield Gardens High School, program students received career information at regular meetings with 
the schoors college counselor. In addition, students participated in two career development days, one on-site and 
the other at Queens College. Eleventh graders participated in an internship program sponsored by the New York 
City Public Schools. 

Students at Fort Hamilton High School attended a college fair held at the site and participated in the State 
University of New York (SUNY) Cx)mmunity Outreach Program's Fifth Annual College Fair held at the Brooklyn 
Academy of Music. 

Project met objective for career advisement. 



Other Activities 

Project CHOICE provided a Bdingual Enrichment Center at both sites. These centers housed the project's 
computers and provided Title VH staff with a place to offer tutoring and counseling to program students. New 
York State Categorical Funds provided an after-school program to prepare students for the Regents Competency 
Test (R.CT.) and Scholastic Aptitude Test (S.A.T.). 

The project provided a number of cuhural activities for project students. Students at Fort Hamilton High 
School went on a trip to the United Nations, attended the Ballei Hispinico at Brooklyn College, and the play 
Botdnica at the Spanish Repertory Theater. 

Project CHOICE developed a bilingual project newsletter at both sites and issued it in both the fall and the 
spring. The project also had a parent advisory committee (FAC) at each site. Although it had proposed to 
provide babysitting scn'iccs for the parents of project students, parents never requested these services so they 
were not provided 
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Attendance 



Tlie project did not propose a specific objective for attendance. However, comparative attendance rates are 
shown below. 



ATTENDANCE RATES 

Hi gh School Project Students Mainstream Students Difference 

Fort Hamilton 92.5 82.9 9,6 

Springfield Gardens 95.0 82.2 12.8 



Last year, the project attendance rate was 90.8 at Fort Hamilton High School and 83.3 at Springfield Gardens 
High School. Both schools showed a substantial increase this year. 

Dropout 

• As a result of participation in the program, the dropout rate of the program students will be less than 
mainstream students. 

• DROPOUT RAPES 

High School Project Students Mainstream Students Difference 

Fort Hamilton 6.1 7.1 4.0 

Springfield Gardens 0.7 4.0 -33 

Project met objective for dropout rate. 

Last year, the project dropout rate was 1.4 at Fort Hamilton High School and 1.3 at Springfield Gardens 
High School. 

Grade Retention 

No students were retained in grade. Forty students were retained in grade the previous year. Project 
CHOICE did not formulate a specific objective for the reduction of grade retention, since the entire program was 
viewed as having this purpose. 

Enrollment ui Post-Secondary Institutions 

Several students expressed a desire to enroll in post-secondary institutions. Project CHOICE did not propose 
any objective in this area. 

Students With Special Academic Needs 

Rcicrred to special education. At both sites, students who consistently demonstrated multiple scholastic 
failures but had good attendance records were referred to the School-based Support Team (S.B.S.T) for 
evaluation. No students were referred to special education this year. Last year, one student was referred. 

Remedial programs, No students were referred to remedial programs this year or last year. The project 
offered tutoring to those students requiring it. 



G>fted and lah^nted programs. No students were recommended to programs for the gifted and la!cnled this 
year or last. 

At Fort Hamilton High School, gifted and talented students were placed in honor classes, advanced 
ptacenient^ and/or were referred to special programs for college-bound students offered by local colleges and 
communities. At Spiingneld Gardens High School, gifted and talented students were encouraged to participate in 
a variety of contests, 

Mainstreaming 

Project CHOICE mainstreamcd 9 students (2.1 percent of participants), all at Fort Hamilton High School. 
Last year 15 students (3.4 percent of participants) were mainstrcamed. 

Academic achievement of former project students in mainstream . At both sites, project staff followed the 
academic progress of program students who were mamstreamed. These students continued to use the program*s 
enrichment center and computers and to attend program-sponsored activities. 

No other data were available on any former project students who. had been mainstreamed. 



Staff Development 

• As a result of participation in the program, staff will demonstrate professional growth. 

At Fort Hamilton High School, the resource specialist and educational assistant completed college courses 
during both fall and spring semesters. 

Both sites offered staff workshops on C.A.L, placement issues, dual literacy, cooperative learning strategies, 
maximbJng professional grovMh, evaluating N.LA. achievemenl, methods and materials for teaching bilingual 
social studies, providing quality education to Latino LEP students, multicultural education, E.S.L. instructional 
techniques, and teamwork between the bilingual teacher and the bilingual educational assistant. The project 
director reported J at all staff benefitted from these activities. 

Project met staff development objective. 



Curriculum Development 

The staff at Fort Hamilton High School developed lesson plans for C.A.I, in mathematics and lesson plans for 
N.LA,, E.S.L., and the E.S.L. parental component. 

At Springfield Gardens High School, the staff adapted a social studies glossary. Project staff also translated 
the New York City Public Schools' curriculum guides on computer literacy into the students' native languages and 
evaluated new commercially prepared materials. 

Project CHOICE did not propose an objective in this area. 
Parent Involvement 

• As a resuU of the program the parents of the students in the program will demonstrate more parental 
involvement than the parents of mainstream students. 

Project parents were regularly informed about their child^s progress and met with program teachers at 
scheduled meetings. At Fort Hamilton High School, 73 percent of the program parents attended Open School 
Day/Evening and special assemblies as compared to 51 percent of the non^program parents, and 25 project 
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parents participated in E.SX./Aniericaiiizatioa classes. Mainstream parents did not attend any classes after 
school. 



At Springfield Gardens High School 90 percent of project parents participated in Open School Day /Night 
Conferences. The project director reported that 5 percent of the non-program parents participated in parent- 
teacher conferences. TWenty-eight project parents attended the Parent Institute at the State Association of 
Bihngual Education (SABE) conference and regularly attended E.S.L7 Americanization classes. Nine program 
parents attended high school equivalency classes at the Haitian American United for Progress (HAUP) Center 
and 15 program parents participated in Parent Leadership workshops. Non-program parents did not attend 
classes, workshops, or the SABE conference. 

Project met the objective for parental involvement. 

CASE HISTORIES 
Latino Component: 

D.C. was born in Guatemala in 1974 and came to the United Stales in December 1988. Upon entering Fort 
Hamilton High School in the tenth grade, her English LAB score ranked in the first percentile. She scored in the 
99th percentile on the Spanish LAB, which indicated that she was very literate in her native language. D.C. was 
in the project for three years, during which time the project staff tutored her in the Bilingual Enrichnienl Center. 
She received R.C.T. preparation with the use of project computers and maintained an average of between 84 and 
88 over three years. 

D.C. participated in the project's trips to career fairs, n)useums, and plays and was involved in many 
extracurricular activities. She assisted students in art class, worked on the school yearbook, performed in 
multicultural assemblies, and volunteered as editor for the Spanish section of the schoors Foreign Language 
Department magazine. Much of her artwork was published in this magazine. She graduated in June and was 
interested in pursuing a career in marine biology, She was confident that she would graduate from college, the 
fust m her family to do so. 

Haitian Component: 

TM. was born in Haiti and has participated in the project at Springfield Gardens High School for two years. 
As a result of her participation in the project, T.M, became English proficient and graduated this year with a 92 
percent academic average. She was a member of Arista, the national honor society. T.M. was also a member of 
the Haitian club sponsored by the project and participated in all cultural activities. T.M.'s goal is to complete 
college and ultimately attend medical school. 
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Ai'PENDIX A 



DATA COLLECTION AND ANALYSIS 



CQ^ LECnON 

OREA evaluation consultants visit sites and inierview key personnel The project director gathers data 
and, with the consultant, completes forms (as shown below) as necessary. 

Student Data Form 

This one-page form is filled out by staff for each participating and mainstrcamed student. OREA gathers 
data from this form on backgrounds, demographics, acadenuc outcomes, attendance, referrals, and exit from the 
program. 

Project Director's Questionnaire 

The Project Directoi 's Questionnaire includes questions on staff qualifications, program implemenlation, 
peJods of instruction, and instructional materials and techniques. 

Project Dircctor*s Interview 

The interview gathers information on program and student or staff characteristics not supplied by the 
Project Director's Questionnaire. The interview also allows project staff to offer qualitative data or amplify 
responses to the questionnaire. 

Citywide Test Scores 

OREA retrieves scores centrally from ihe Language Assessment Battery (LAB) and other cityv^'ide tests. 
For evaluation purposes, these test scores are reported in Normal Curve Equivalents (N.C.E.s). N.C.E,s are 
normalized standard scores with a mean of 50 and a standard deviation (s.d.) of 21.06. They constitute an equal* 
interval scale in which the distance is the same between any two adjacent scores. A gain of 5 N.C.E.S is the same 
whether it is at the lower or the higher end of the scale. N.CE.s can be used in arithmetic computations to 
indicate group progress. (Percentile scales, although more famihar to many, are unsuhable for such computations 
since they are not equal-interval.) 

Likert-Tvpe Surveys 

Likert-type surveys, in which respondents mark their opinions on a scale from one to five, are used In a 
variety of ways. Tliey examine student attitudes (i.e., toward school and career, native language use, and native 
and mainstream cultures). They also assess staff and parent attitude and reactions to workshops and other 
activities. 



ANALYSIS 

Gap Reduction Evaluation Design 

OREA uses a gap reduction design for measuring changes in standardized tests. Since no appropriate 
non-project comparison group is available in New York City, where all students of limited English proficiency 
(LEP) arc entitled to receive supplementary services, OREA compares the progress of participating students with 
that of the group on which the test was normed. It is assumed that the norm group would show a zero gain in 
the absence of instruction, and gains made by project students could be attributed to project services. Scores are 
reported in Normal Curve Equivalents (N.C.E.s), which are normalized standard scores with a mean of 50 and a 
standard deviation of 2L06 (See "Citywide Test Scores" above.) 

To test whether pre/posttest gains are greater than could be expected by chance alone, OREA uses a /- 
test. To test whether a difference between two proportions (e.g., program and mainstream attendance rates) is 

1.G 



greater than could be expected by cinnce, ORE A uses a 2-icst and reports the differences between the two 
proportions. The level of significance is set ai ,05 for all tests. 

Techniques For Miuinii2ia£ Error 

The evaluation procedures minimize error by providing for proper administration cf evaluation 
instruments through a combinaiion of 'csiing at l2-nionth intervals, appropriate analysis procedures 
and reporting. 

Instruments of measurement include the LAB (see above)> the Degrees of Reading Power (D.R.P.) test, 
the Metropolitan Achievement Test-Mat hematics (MAT-Math), El Exanien de Lectura en Esparlo] (ELE), 
Likert-type scales (see above), and project-developed tests. Except for Likert scales and project ^developed tests, 
these instruments are scored on a citywide basis at the Scan Center of the New York City Public Schools. 
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APPENDIX B 



N.Y.C. Board of Education, 1980 
Prentice Hall Regents, 1988 
Prentice HalJ Regents, 1985 



/iddison-Wcsley, 1984 
Houghton, Mifnin Co.,1981 
Educational Activities Inc., 1985 
Prentice Hall Regents, 1985 



Heath, 1966 
Anisco, 1975 

Houghton, Mimin Co. 1973 



English as a Second Language 

Fort Hamilton Hifih School 

Reading and Writing SIdlls 
A New Beginning 
From Sea to Shining Sea 

Springfield Gardens High School 

Stdll Sharpeners for E,S.L. Students 
English Alpha 

Computer Assisted Instruction 
Great American Stories 1 



Native Language Arts 

Fort Hamilton High School 

Nuevos cuentos contados 
Un verano en Mejico 
El Hidalgo de la Mancha 

Springfield Hamilton High School 
Tezen 

Haitian Creole, Vol. I and II 

Fie Dize 

Esperans Dezire 

Lekti Ak Graame 

Let/d Kreyol 

Ann Aprann Li Pi Byen 

Djakoiit I,2j3y4 

Mathematics 

Fort Ha mi lton High School 

General Mathematics 
Prelim inary Mathem a tics 
Mathematics: A Topical Approach 
Matematicas 

Springfield Gardens High School 



INSTOUCTIQNAL MATERIALS 



S. Siegal 

Church, Hyzer, Niedermeier 
Harris 



Filippo, Skidniore, Walker 
Kenton, Sutherland 
Han^ilton, Hombs 
Draper 



Pitarro 
Cabat 
D. Quilter 



Madhere 
Valdman 
Martineau 
Deyla 

Komite Karitas 



Project CHOICE 
Felix Moriso Lewa 



Lawrence. Rucker, Ockenga 
Dressier 
Bumby, Klutch 
Orfan, Vogeli 



Indiana Univ. Creole Institute, 1981 



Edition Henri Deschamps, 1989 
Imprimerie Henri Deschamps 
Enstiti Pedagogik Nasyonal, 1988 
NYC Board of Education, 1990 
Ed Haitians Publications, 1990 



Heath, 1985 
Amsco, 1981 
MerrUl, 1982 

Silver Burdett & Ginn 1989 



Laidlaw Brothers, Pub., 1956 
Barron's Educational Series Inc., 1984 
Not Reported, 1980 
Barron's Educational Series, 1984 
NYC Board of Education, 1990 



Ench, 1987 



Applying Mathamatics 
Fundamentals of Mathamatics, Vol. II 
Intergrated Mathematics Course I and II 
Fundamentals of Math 
Annou Dekouvri Aljeb 
KaUdl ak Sistem Metrik 
Problem Jeyomitri 



Shutle, Haynes, Choate 
Cullen, Petruzillo, Cohen 
Dressier, Keenan 
Cecilia Cullens 
Project CHOICE 
Ed des Antilles 
Ed, Caritas 



Science 



ERIC 



Fort Hamilton High School 

La energia y la materia 
Biologia 

Springfield Gardens Hiph School 

Syans Fizik 9ih Year Creole Edition 
Modem Physical Science 
Physics 

Conceptual Physics 

Chemistry Workshop 

Gid LaborativQ Biyoloji (Lab I) 

Social Studies 

Fort Hamilton High Schools 

Historia Universal 

EuropOj Africa, Asia, Australia 

Canada y America Laiina 



Hcimlcr» Price 
Alexander, Bahrct, Cliavez 



Project Mobile, Title VII 

Tracy, Tropp, Fried! 

Bciser 

Hewitt 

Rosen 



Bartoli» Martinez 

Elbow 

Elbow 



Merrill, 1985 

Silver Burdett & Ginn, 1987 



B.O.E. Experimental Edition 
Holt, Rinehari, Winston, 1983 
Cummings Pub. Co., 1972 
Addison Wesley, 1987 
Globe Book Co., 1983 
NYC Board of Education, 1991 



Trillas, 1988 

Silver Burdett & Ginn, 1985 
Silver Burdett & Ginn, 1985 



Springfield Gardens High SchooJ 

Gbbal Studies Barron Review 
Global S (14 dies 

Gbbal StudieS'A Compelency Review 
Civilization of the Past 
[stwa Jeneral le Pati 



Willner, Wiener, Hero 
Brun 

Osborne, O'Donneil 
Brun 



Barrons, 1990 
Anisco Inc., 1988 



Anisco Inc., 1988 

NYC Board of Education. 1992 
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